• Support from NICHD, NIH OD, NIMH, NIDA, OBSSR, NSF
• Karen Adolph, Cathie Tamis-LeMonda, Orit Hertzberg, Tiger Teng

• What is PLAY
• Why PLAY
• Challenges..met and meeting
• A preview
• Let play be our work

https://anhourinthelife.org

• ~1,000 mother-infant dyads (12-, 18-, 24-mos)
• 1 hr natural behavior (video)
• 5 min structured play (video)
• House tour (video)
• Parent-report questionnaires
• Ambient sound levels

• Foundational video coding passes
  • Speech & language
  • Emotional expression
  • Object interaction
  • Locomotion & physical activity

• Common, openly shared dataset
• Dataset as deliverable
• Rigorous QA control
• Investigator-specific questions…
• Catalyze/expand capacity to exploit video
• Pioneer & polish tools for big data open developmental science

• Rich, varied, interesting, & important (Adolph, 2020)
• Can be captured with video (Adolph, K.E., Gilmore, R.O., & Kennedy, J.L., 2017)
• Can be analyzed systematically by human observers
• Environments outside the lab most representative of children’s experiences
• Tackling the ‘generalizability crisis’ head-on (Yarkoni, 2020)

• (R. O. Gilmore, 2016)
• No comparable corpus

(Szucs & Ioannidis, 2017)

“Assuming a realistic range of prior probabilities for null hypotheses, false report probability is likely to exceed 50% for the whole literature.”

• Presents opportunities (Gennetian, Tamis‐LeMonda, & Frank, 2020)
• Poses surmountable challenges (R. Gilmore, Cole, Verma S, Aken, & Worthman, 2020)
• “…is essential for for improving the health and well-being of humanity…”

“The advancement of detailed and diverse knowledge about the development of the world’s children is essential for improving the health and well-being of humanity. The Society for Research in Child Development (SRCD) regards scientific integrity, transparency, and openness as essential for the conduct of research and its application to practice and policy. These values apply to research conduct, to the teaching of scientific methods, and to the translation of science into practice and policy.”

• “will be more rigorous, robust, and impactful” (R. Gilmore & Qian, 2021)

• Planning workshop: https://nyu.databrary.org/volume/254
• Web site (https://play-project.org), https://github.com/PLAY-behaviorome/PLAY-project.org
• Data management & curation (Soska et al., 2021)
• Planning for future reuse

• Only restricted access data library specialized for storing & sharing video/audio for research purposes
  • Protect identifiable or sensitive data
  • Openly (but not publicly) share identifiable or sensitive data
• Video as data (Adolph, K.E., Gilmore, R.O., & Kennedy, J.L., 2017), demonstration, & documentation (R. Gilmore & Adolph, 2017)
• Developed by and especially for developmental scientists

• Who to include
• Age range(s)
• What language backgrounds
• Where to sample
• What to vary, what to keep constant…

• Is ‘an hour in the life’ representative?
• What parent-report survey questions & how to collect
• What behaviors to code from video

• 12-mo-olds, 18-mo-olds, & 24-mo-olds
• Only English and Spanish-speaking households
• Mom and child
• 31 sites

• Informed by Census demographics
  • https://github.com/PLAY-behaviorome/site-demographics
  • tidycensus R package
  • collection-site-demographics.Rmd

• Health
• Patient Health Questionnaire (PHQ-4)
• Locomotor milestones
• MacArthur-Bates Communicative Development Inventory (MB-CDI)

• Early Childhood Behavior Questionnaire (Rothbart)
• Media use
• Pets
• Household structure
• Typical day

https://nyu.databrary.org/slot/27087/0,372193/asset/119877/download?inline=true

• Findable, usable beyond launch group
• Limitations of Databrary 1.0
  • Data in-process vs. data shared
  • Virtual volumes
• Versioning data, protocol, coding schemes
• IRB

• Add-on, follow-up studies
  • New data
  • Augmented, new video annotations
• COVID-19

• 1-hour natural play: https://nyu.databrary.org/slot/18825/78777000,82445800/asset/85849/download?inline=true
• House walk-through: https://nyu.databrary.org/slot/18825/69908000,70431136/asset/85853/download?inline=true
• Structured play: https://nyu.databrary.org/slot/18825/85767000,86228590/asset/85865/download?inline=true

• Parent-report questionnaires: https://nyu.databrary.org/slot/18825/82179000,85191864/asset/85867/download?inline=true

• Make use of databraryapi R package that interacts with Databrary API
  • (R. O. Gilmore, n.d.)
• Reproducible data cleaning, visualization, and analysis scripts from the get-go

databraryapi::login_db("myemail@university.edu")

play_data <- databraryapi::read_csv_data_as_df(session_id = 51539, asset_id = 366382)

xtabs(formula = ~ child_sex + age_group, data = play_data) %>%
  knitr::kable(., format = 'html') %>%
  kableExtra::kable_classic(.)

xtabs(formula = ~ child_race + child_ethnicity, data = play_data) %>%
  knitr::kable(., format = 'html') %>%
  kableExtra::kable_classic(.)

• Databrary has demographic data from \(n=9,342\) participant sessions.
• Race (NIH categories), Ethnicity (NIH categories), Gender
• Building foundation for future searching and filtering by participant characteristics

xtabs(formula = ~ typical_behavior + age_group, data = typical_data) %>%
  knitr::kable(., format = 'html') %>%
  kableExtra::kable_classic(.)

xtabs(formula = ~ typical_nightmorning + age_group, data = typical_data) %>%
  knitr::kable(., format = 'html') %>%
  kableExtra::kable_classic(.)

## [1] TRUE

• Big data developmental science of natural behavior is possible & necessary
• Cognition and emotion in context
• Ambition and vision drive innovation
• Future-orientation (what will future researchers want to know) challenging, but invigorating
• What do we want our science to be about?

• Collaborate with a launch group member
• Write grants to use the data
• Help test, polish the databraryapi R package and complete the Python package
• Help shape, test Databrary 2.0
• Make developmental science a leader in big data reseearch on behavior

This talk was produced on 2022-04-18 in RStudio using R Markdown and the ioslides framework. The code and materials used to generate the slides may be found at https://github.com/PLAY-behaviorome/2022-04-21-team-sci-cds/. Information about the R Session that produced the code is as follows:

## R version 4.1.2 (2021-11-01)
## Platform: x86_64-apple-darwin17.0 (64-bit)
## Running under: macOS Monterey 12.3
## 
## Matrix products: default
## LAPACK: /Library/Frameworks/R.framework/Versions/4.1/Resources/lib/libRlapack.dylib
## 
## locale:
## [1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8
## 
## attached base packages:
## [1] stats     graphics  grDevices utils     datasets  methods   base     
## 
## other attached packages:
## [1] forcats_0.5.1   stringr_1.4.0   dplyr_1.0.8     purrr_0.3.4    
## [5] readr_2.1.1     tidyr_1.1.4     tibble_3.1.6    ggplot2_3.3.5  
## [9] tidyverse_1.3.1
## 
## loaded via a namespace (and not attached):
##  [1] httr_1.4.2         sass_0.4.1         jsonlite_1.8.0    
##  [4] viridisLite_0.4.0  splines_4.1.2      modelr_0.1.8      
##  [7] bslib_0.3.1        shiny_1.7.1        assertthat_0.2.1  
## [10] highr_0.9          cellranger_1.1.0   yaml_2.3.5        
## [13] lattice_0.20-45    pillar_1.7.0       backports_1.4.1   
## [16] glue_1.6.2         digest_0.6.29      promises_1.2.0.1  
## [19] rvest_1.0.2        colorspace_2.0-3   Matrix_1.3-4      
## [22] htmltools_0.5.2    httpuv_1.6.5       pkgconfig_2.0.3   
## [25] broom_0.7.11       haven_2.4.3        xtable_1.8-4      
## [28] scales_1.2.0       webshot_0.5.2      svglite_2.0.0     
## [31] later_1.3.0        tzdb_0.2.0         mgcv_1.8-38       
## [34] farver_2.1.0       generics_0.1.2     ellipsis_0.3.2    
## [37] withr_2.5.0        cli_3.2.0          magrittr_2.0.3    
## [40] crayon_1.5.1       readxl_1.3.1       mime_0.12         
## [43] evaluate_0.15      fs_1.5.2           fansi_1.0.3       
## [46] nlme_3.1-153       xml2_1.3.3         tools_4.1.2       
## [49] hms_1.1.1          lifecycle_1.0.1    munsell_0.5.0     
## [52] reprex_2.0.1       kableExtra_1.3.4   compiler_4.1.2    
## [55] jquerylib_0.1.4    systemfonts_1.0.3  rlang_1.0.2       
## [58] grid_4.1.2         rstudioapi_0.13    miniUI_0.1.1.1    
## [61] labeling_0.4.2     rmarkdown_2.13     gtable_0.3.0      
## [64] DBI_1.1.2          curl_4.3.2         R6_2.5.1          
## [67] lubridate_1.8.0    knitr_1.38         keyring_1.3.0     
## [70] fastmap_1.1.0      databraryapi_0.2.8 utf8_1.2.2        
## [73] ggExtra_0.9        stringi_1.7.6      Rcpp_1.0.8.3      
## [76] vctrs_0.4.1        dbplyr_2.1.1       tidyselect_1.1.2  
## [79] xfun_0.30